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Abstract 

Parabolic R-polynomials were introduced by Deodhar as parabolic analogues of ordinary 
^-polynomials defined by Kazhdan and Lusztig. In this paper, we are concerned with the 
computation of parabolic ^-polynomials for the symmetric group. Let S n be the symmetric 
group on {1,2,..., n}, and let S = {s^ 11 < i < n — 1} be the generating set of S n , where 
for 1 < i < n — 1, Si is the adjacent transposition. For a subset J C S, let ( S n )j be the 
parabolic subgroup generated by J, and let ( S n ) J be the set of minimal coset representatives 
for S n /(S n )j. For u < v £ ( S n ) J in the Bruhat order and x £ {q, —1}, let R^(q) denote 
the parabolic -R-polynomial indexed by u and v. Brenti found a formula for R J U '% (q) when 
J = S \ { Si }, and obtained an expression for R^’% ( q ) when J = S \ { sj_ i, s,}. We introduce 
a statistic on pairs of permutations in ( S n ) J for J = S \ {sj_ 2 , s,-i, Si}. Then we give a 
formula for /?,.{'{ (q), where J = S \ 2 , Sj_i, s,} and i appears after i — 1 in v. We also 

pose a conjecture for R^(q), where J = S \ {sfc, Sk+i, ..., s^} with \ <k<i<n — 1 and 
the elements k + 1, k + 2,..., * appear in increasing order in v. 
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1 Introduction 

Parabolic R-polynomials for a Coxeter group were introduced by Deodhar [4] as parabolic 
analogues of ordinary i?-polynomials defined by Kazhdan and Lusztig [7]. In this paper, we 
consider the computation of parabolic R-polynomials for the symmetric group. Let S n be the 
symmetric group on {1,2,..., n}, and let S = {si, s 2 , ■ ■ ■, s n -i} be the generating set of S n , 
where for 1 < i < n — 1, s* is the adjacent transposition that interchanges the elements i 
and i + 1. For a subset J C S, let (S n )j be the parabolic subgroup generated by J, and let 
( S n ) J be the set of minimal coset representatives of S n /(S n )j. Assume that u and v are two 
permutations in ( S n ) J such that u < v in the Bruhat order. For x € {g, —1}, let Ru^,{q) denote 
the parabolic R-polynomial indexed by u and v. When J = S\ {sj}j Brenti [2] found a formula 
for Recently, Brenti [3] obtained an expression for R^,’%(q) for J = S \ {sj_i,Sj}- 

In this paper, we consider the case J = S\{s,_ 2 , Sj_i, s*}. We introduce a statistic on pairs 
of permutations in ( S n ) J and we give a formula for Ru^(q), where i appears after i — l in v. We 
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also conjecture a formula for R,uf(q), where J = S\ {s*,, s^+i,..., s*} with l<k<i<n— 1 
and the elements k + 1, k + 2,..., i appear in increasing order in v. 

Let us begin with some terminology and notation. For a Coxeter group W with a generating 
set S, let T = {wsw~ ] \ w £ W, s £ S'} be the set of reflections of W. For w £ W, the length 
£(w) of w is defined as the smallest k such that w can be written as a product of k generators in 
S. For u, v € W, we say that u < v in the Bruhat order if there exists a sequence t\, t 2 , ■ ■ ■, t r 
of reflections such that v = ut\t 2 ■ ■ ■ t r and £{ut\ ■ ■ ■ ti) > £{ut\ ■ ■ ■ tj_i) for 1 < i < r. 

For a subset J C 5, let Wj be the parabolic subgroup generated by J, and let W J be the 
set of minimal right coset representatives of W/Wj, that is, 

W J = {w £W | £{sw) > £(w), for all s £ J}. (1.1) 

We use Dr{w) to denote the set of right descents of w, that is, 

Dr{w) = {s £ S | £(ws) < £{w)}. (1.2) 

For u, v £ W J , the parabolic ^-polynomial R'u^(q) can be recursively determined by the 
following property. 

Theorem 1.1 (Deodhar [4]) Let (W, S) be a Coxeter system and J be a subset of S. Then, 
for each x £ {q, — 1}, there is a unique family {Ru,v(q)} u vgw j of polynomials with integer 
coefficients such that for all u, v £ W J , 

(i) ifu-^v, then R^f^q) = 0; 

(ii) if u = v, then Ruf{q) = 1; 

(iii) if u < v, then for any s £ Dr{v), 

Rif,vs{q), if S £ D r (u), 

qRus,vs{q) + {q- 1 )Ru*vs{q), if s ^ D R (u) and us £ W J , 

(q- 1 - x)Ru X vs (q), if s D R (u ) and us ^ W J . 

Notice that when J = 0, the parabolic U-polynomial Ruf(q) reduces to an ordinary R- 
polynomial R u ^ v (q), see, for example, Bjorner and Brenti [1, Chapter 5] or Humphreys [6, 
Chapter 7]. The parabolic ^-polynomials Ruf(q) for x = q and x = —1 satisfy the following 
relation, so that we only need to consider the computation for the case x = q. 

Theorem 1.2 (Deodhar [5, Corollary 2.2]) For u,v £ W J with u < v, 

Q) = ( _ 1) t(D-^) jR 7-1 (?) . 

There is no known explicit formula for Ruf(q) for a general Coxeter system ( W, S ), and 
even for the symmetric group. When W = S n , Brenti [2,3] found formulas for Ruf,(q) for 
certain subsets J, namely, J = S \ {.s,} or J = S \ {sj_i,Si}. To describe the formulas for 
the parabolic .^-polynomials obtained by Brenti [2,3], we recall some statistics on pairs of 
permutations in ( S n ) J with J = S \ {s*} or J = S \ {sj_i, s*}. 
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A permutation u = U\U 2 ■ ■ ■ u n in S n is also considered as a bijection on {1,2,..., n} such 
that u(i) = Ui for 1 < i < n. For u,v £ S n , the product uv of u and v is defined as a bijection 
such that uv(i) = u(v(i )) for 1 < i < n. For 1 < i < n — 1, the adjacent transposition s t is the 
permutation that interchanges the elements i and i + 1. The length of a permutation u G S n 
can be interpreted as the number of inversions of u, that is, 

^(«) = |{(*,j) 11 < * < j < n, u{i) > u(j)}\. (1.3) 

By (1.2) and (1.3), the right descent set of a permutation u G S n is given by 

D r (u ) = {sj 11 < i < n — 1, u(i ) > u(i + 1)}. 

When J = S\ {s*}, it follows from (1.1) and (1.3) that a permutation u G S n belongs to 
(S n ) J if and only if the elements 1, 2,..., i as well as the elements i + 1, i + 2,..., n appear in 
increasing order in u, or equivalently, 

u -1 (l) < u~ 1 (2) < ■■ ■ < u~ l (i) and vT x (i + 1) < « _1 (i + 2) < • • • < u~ l (n). 

For n > 1, we use [n] to denote the set {1,2,..., n}. For J = S \ {sj} and u, v G (S n ) J , let 

H(u,u) = u- 1 ([i])\W 1 ([z]). 

For 1 < j < n, let 

aj(u,v) = \{r G u _ 1 ([i]) |r < j}\ - |{r € u _1 ([z]) \r < j}\. 

Brenti [2] obtained the following formula for Ry'%(q). where J = S \ {s*}. 

Theorem 1.3 (Brenti [2, Corollary 3.2]) Let J = S \ {sj}, and let u, v G ( S n ) J with u < v. 
Then 

R$«(q) = (-l)^)- £ (“) Y[ (l - q a ^n,v)^ _ 

j£D(u,v) 


We now turn to the case J = S\ Sj}. In this case, it can be seen from (1.1) and (1.3) 

that a permutation u € S n belongs to ( S n ) J if and only if 

u -1 (l) < u~ 1 (2) < ■■■ < u _1 (i — 1) and u _1 (i + 1) < it -1 (* + 2) < • • • < u _1 (n). 

For u, v G (S n ) J , let 

D(u,v) = u _1 ([i - 1]) \u -1 ([* - 1]). 

For 1 < j < n, let 

aj(u,v) = |{r G u _1 ([i - 1]) | r < j}\ - |{r € u _1 ([i - 1]) |r < j} |. 

The following formula is due to Brenti [3]. 


Theorem 1.4 (Brenti [3, Theorem 3.1]) Let J = S \ {sj_i,Sj} 7 and let u,v G (S n ) J with 
u < v. Then 


R J u q v (q) = 


(_!)*(«) Ru) _ q + C q l+a,v Y\jeD(u,v) (* “ q a ^ u,v ^) , if u 1 (i)>v 1 (i), 

(_1 y{v)-t(u) _ q + c? i+5„-i (l) («,dj UjeDM ( X - > if « _1 (0 < v _1 (0, 

where c = is the Kronecker delta function. 
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It should be noted that the sets ( S n ) J for J = S \ {sj} and J = S\ are called 

tight quotients of S n by Stembridge [ 8 ] in the study of the Bruhat order of Coxeter groups. 
Therefore, combining Theorem 1.3 and Theorem 1.4 leads to an expression for the parabolic 
^-polynomials for tight quotients of the symmetric group. 

In this paper, we obtain a formula for Ru^(q), where J = S\ {sj- 2 , Sj-i, s*} and i appears 
after i — 1 in v. We also conjecture a more general formula for Ruf,(q), where J = S \ 
{sk, Sk+ 1 ,..., s«} with \ <k<i<n — 1 and the elements k + 1 , k + 2 ,..., i appear in 
increasing order in v. 


2 A formula for Rif q v {q ) with J = S \ {s*_ 2 , s*-i, 

In this section, we present a formula for RuRq ), where J = S \ {sj_ 2 , Sj_i, Sj} and v is a 
permutation in ( S n ) J such that i appears after i — 1 in v. We also give a conjectured formula 
for Ru? v (q), where J = S \ {s*,, sj, +1 ,..., s,;} with l<k<i<n — 1 and the elements 
k + l,k + 2, ... ,i appear in increasing order in v. 

For u, v € ( S n ) J with u < v, our formula for Ru’ q (q) relies on a vector of statistics on (u, v ), 
denoted (ai(u,v),d 2 (u,v),... ,a n (u,v)). Notice that a permutation u £ S n belongs to ( S n ) J 
if and only if the elements 1 , 2 ,...,* — 2 as well as the elements i + l,i + 2,... ,n appear in 
increasing order in u. To define a,j(u, v ), we need to consider the positions of the elements i— 1 
and i in u and v. For convenience, let u -1 = P 1 P 2 • • • p n and v^ 1 = q\q 2 • • • q n , that is, t appears 
in position p t in u, and appears in position q t in v. The following set A(u, v ) is defined based 
on the relations pi -1 > qi-\ and pi > qi. More precisely, A(u,v ) is a subset of {i — 1 , *} such 
that i — 1 G A(u, v ) if and only if 1 > qt-i, and i € A(u, v ) if and only if Pi > q%. Set 

B(u, v ) = (1,2,..., i — 2} U A(u, v). 

For 1 < j < n, we define aj(u, v ) to be the number of elements of B(u, v ) that are contained 
in {tii, • • •, Uj- 1 } minus the number of elements of B(u, v ) that are contained in {iq,..., Vj- 1 }, 
that is, 

aj(u,v) = \{r 6 w _ 1 (B(?x,u)) | r < j}\ - |{r € v~ 1 {B(u,v))\r < j}\. (2.1) 

For example, let n = 9 and i = 5, so that J = S \ { 53 , S 4 , S 5 }. Let 

u = 416273859 and v = 671489253 (2.2) 

be two permutations in (Sg) J . Then we have A(u,v) = {5}, B(u,v ) = {1,2,3,5}, and 

(ai(u,v), .. .,a 9 (u,v)) = (0,0,1,0,1,1,2,1,1). (2.3) 

The following theorem gives a formula for RuRq)- 

Theorem 2.5 Let J = S \ {sj_ 2 , Sj_i, Sj}, and let v be a permutation in ( S n ) J such that i 
appears after i — 1 in v. Let 

D(u , v) = v~ 1 (B{u , v)) \ u~ 1 (B(u , v)). (2.4) 

Then, for any u € ( S n ) J with u <v, we have 

R J u’ q v (q ) = (-1 Y {v) ~ i{u) (l-« + ^(i- 1 ),r 1 (H)! 1+Vl(i - 1)M ) 
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i i r 1+a —i/-\(u,v) 

i - q + K-Hi),v-Hi)<i v w 


n 

j£D(u,v) 


\-q a - 


(u,v) 


(2.5) 


Let us give an example for Theorem 2.5. Assume that u and v are the permutations as 
given in (2.2). Then we have D(u,v ) = {3,7,9}. In view of (2.3), formula (2.5) gives 

R J u q v(.q) = (i - q) 3 ( l - <? 2 )(i - q + q 2 )- 

To prove the above theorem, we need a criterion for the relation of two permutations in 
(S n ) J with respect to the Bruhat order. For a,w£ (S n ) J and 1 < j < n, let 


II 

'77 

3 , 

-O 

{r £ u 1 ([z — 2 ]) | r < j }| 

- {r £ u _1 ([* - 2 ]) \r < j}\ , 

( 2 . 6 ) 

b 2 ,j(u,v) = | 

{r £ u _1 ([i - 1 ]) \r < j}\ 

- {r £ u _1 ([i - 1 ]) \r < j}\ , 

(2.7) 

II 

'77 

3 

CO 

-0 

{r £ u _ 1 ([z]) \r < j}\ - ( 

r £ u _ 1 ([i]) | r < j}\ . 

( 2 . 8 ) 


The following proposition shows that we can use bhj(u,v ) with h = 1,2,3 and 1 < j < n to 
determine whether u < v in the Bruhat order. 

Proposition 2.6 Let J = S \ {sj- 2 , Sj-i, Si}, and let u, v £ (S n ) J . Then, u < v if and only if 
bhj(u, v) > 0 for h = 1,2, 3 and 1 < j < n. 

Proof. Recall that for u, v £ S n , the following statements are equivalent [1, Chapter 2]: 

(i) u <v\ 

(ii) u ' 1 < u _1 ; 

(iii) for any 1 < j < n and any 1 < t < n, 

|{r € u([t]) | r < j}\ > |{r € v([t]) \ r < j}\ . 

(iv) for any 1 < j < n and any t such that St € Dr(u), 

\{r € u([t)) | r < j }| > |{r € v([t]) | r < j}\ . 

Therefore, it suffices to show that for u, v £ (S n ) J , u -1 < v if and only if bhj(u,v) > 0 for 
h = 1 , 2 ,3 and 1 < j < n. 

Notice that the elements 1,2,...,* — 2 as well as the elements i + 1, i + 2,..., n appear in 
increasing order in u. We see that if s t £ H^(u _1 ), then t equals i — 2, i — 1, or i. Thus, 
u < u -1 if and only if for h = 1,2,3 and 1 < j < n, 

|{r £ u _1 ([i — 3 + h]) \ r < j}\ > [{r £ v~ l {[i — 3 + h)) \ r < j }| , 

or equivalently, u _1 < if and only if bhj(u,v) > 0 for h = 1,2,3 and 1 < j < n. This 
completes the proof. I 

We are now in a position to present a proof of Theorem 2.5. 

Proof of Theorem 2.5. Assume that J = S\ 2 , Sj-i, s*}, and u and v are two permutations 
in ( S n ) J such that u < v. Write u” 1 = P 1 P 2 ■ ■ -p n and v~ l = q\q 2 • • • q n - By the definitions of 
(ai(u, v),... , a n (u, v)) and D(u, v), we consider the following four cases: 

Pi -1 > Qi-\ and p t > q u (2.9) 
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Pi-1 > Qi -1 

and 

Pi < Qi , 

( 2 . 10 ) 

Pi -1 < Qi -1 

and 

Pi > Qi, 

( 2 . 11 ) 

Pi-l < Qi-l 

and 

Pi < Qi- 

( 2 . 12 ) 


We conduct induction on £{v). When £{v) = 0, formula (2.5) is obvious. Assume that 
£{v) > 0 and formula (2.5) is true for £{v) — 1. We proceed to prove (2.5) for £(v). We shall 
only provide a proof for the case in (2.10). The other cases can be justified by using similar 
arguments. By (2.1) and (2.10), we see that for 1 < k < n, 

ak(u, v ) = |{r G u~ l (\i — 1]) | r < fc}| — |{r G v~ l ([i — 1]) | r < k}\. (2-13) 

Moreover, by (2.4) and (2.10) we find that 

D(u,v)=v-\[i-l})\u- 1 ([i-l]). (2.14) 


Let Sj G D r (v) be a right descent of v, that is, v(j) > v(j + 1), where 1 < j < n — 1. Keep 
in mind that i appears after i — 1 in v, namely, qi > qi-i, and that the elements 1 , 2 ,..., i — 2 
as well as the elements i + 1, i + 2 ,..., n appear in increasing order in v. So we get all possible 
choices of v(j ) and v(j + 1) as listed in Table 2.1. 


1 

v(j) > i and v(j + 1 ) = i 

2 

v{j) > i and v(j + 1 ) = i — 1 

3 

v(j) > i and v(j + 1 ) < i — 1 

4 

v(j) = i and v(j + 1 ) < i — 1 

5 

v(J) =i — l and v{j + 1 ) < i — 1 


Table 2.1: The choices of v(j ) and v(j + 1) in v. 


According to whether Sj is a right descent of u, we have the following two cases. 

Case 1: Sj G Dr(u), that is, u(j) > u(j + 1). Since the elements 1,2,... , z — 2 as well as the 
elements i + l,i + 2 ,... ,n appear in increasing order in u, the possible choices of u(j) and 
u(j + 1) are as given in Table 2.2. 


1 

u(j) 

> i 

and 

u(j 

+ 1 ) =* 

2 

u(j) 

> i 

and 

u(j 

+ 1 ) = *-l 

3 

“O') 

> i 

and 

“0 

+ 1 ) <*-l 

4 

“ 0 ) 

= i 

and 

u(j 

+ 1)=*-1 

5 

“ 0 ) 

= i 

and 

u(j 

+ 1 ) <*-l 

6 

“ 0 ) 

= i 

- 1 

and 

u{j + !)<* — ! 


Table 2.2: The choices of u(j) and u(j + 1) in u in Case 1. 

We only give a proof for the case when v satisfies Condition 5 in Table 2.1, that is, v(j ) = i—1 
and v(j + 1) < i — 1. The remaining cases can be dealt with in the same manner. By the 
classification of u in Table 2.2, there are six subcases to consider. 
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Subcase 1: u(j) > i and u(j + 1) = i. By (2.1), it is easy to check that for 1 < k < n, 

a k (usj,vsj ) = a k (u,v). 

Moreover, it follows from (2.4) that 


D(usj,vsj) = D(u,v). 


By the induction hypothesis, we deduce that 

R J u q v(q) = RXvsM) 

= (_1 y(. v Sj)-e(MSj) (I _ g) 2 ^ _ q a k (usj,vsj) 

k^D(usj ,vsj) 

= (-1 )<(«M(«) (1 _ q f JJ (l - j , 

k£D(u,v) 


as required. 


Subcase 2 : u(j) > i and u(j + 1) = i — 1. Notice that in this case usj and vsj satisfy the 
relation in (2.12). So we have B(usj,vsj) = [i — 2], By (2.1) and (2.4), it is easily verified that 
for 1 < k < n, 

a k (usj,vsj ) = a k (u,v), 


and 


D(usj,vsj) =(vsj) 1 ([i-2])\(us j ) Hi*- 2 ]) 

=« _1 ([* — 1]) \ t* _1 ([* — 1]) 

=D(u, v). 

By the induction hypothesis, we get 
Ru?v(q) =Rus j ,vs j (<l) 

(l _ g) 2 n ( 1 _ q a k (u Sj ,v Sj )^ 

k£D(usj ,vsj) 

=(-l )<(«M(«) (1 - q )2 Y\ (l - q a ^ u ’ v ^ , 

k£D(u,v) 

which implies (2.5). 

Subcase 3: u(j) > i and u(j + 1) < i — 1. We find that 

a,j+i(usj, vsj) = a,j+i(u, v) + 1 and a k (usj,vsj) = a k (u,v), forfe^j + 1, 

and 

D(usj,vsj ) = (D(u,v) \ {i}) U {j + 1}. 

Thus, the induction hypothesis yields that 

R J u%(q) =Rttvs J (<i) 

= (_l)^Sj)-^(“Sj)(l _ g) 2 n ( 1 _ 

k£D(usj,vsj) 
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^ 1 — gf a j + l( WS J t V8 j) 
l _ qClj(u,v) 


k£D(u,v) 


which reduces to (2.5), since 


Oj+i(itSj, usj) = a,j(u,v) 


Subcase 4: 'u(j') = i and u{j + 1) = i — 1. This case is similar to Subcase 2 , and hence the 
proof is omitted. 

Subcase 5: u(j) = i and u(j + 1) < i — 1. This case is similar to Subcase 3. 

Subcase 6 : u(j) = i — 1 and u(j + 1) < i — 1. For 1 < k < n, we have 

a k (usj,vsj) = a k (u,v ) 

and 

D(usj,vsj) = D(u,v). 

By the induction hypothesis, we find that 

= R us j ,vs j ( ( l) 

= (_1 yivs^-HuSj) ^ _ q _|_ ql+aj+^us^vsj)^ ^ ^ n ( 1 - q a k( us j’ vs j)^ . 

k£.D(usj ,vsj) 

(2.15) 


Noticing the following relation 


a,j+i(usj, vsj) = a,j(u,v), 


formula (2.15) can be rewritten as 

R J u q M) = (-l) /(w) - /(tt) (l -q + g 1 +a J(“>'")) (1 - q) (l - , 

k£D(u,v) 


as required. 


Case 2: Sj 0 Dr(u), that is, u(j) < u(j + 1). The possible choices of u{j) and u(j + 1) are 
given in Table 2.3. 


1 

u{j) < u(j + 1 ) < i - 1 

2 

u{j) < u(j + 1 ) = i - 1 

3 

u(j) < i — 1 and v(j + 1 ) = i 

4 

u(j ) = i — 1 and u(j + 1) = i 

5 

u(j ) < z — 1 and u(j + 1 ) > z 

6 

u(j) = z — 1 and u(j + 1 ) > i 

7 

i = u(j) < u(j + 1 ) 

8 

i < u(j ) < u(j + 1 ) 


Table 2.3: The choices of u(j) and u(j + 1) in u in Case 2. 












We shall provide proofs for three subcases: (i) v satisfies Condition 1 in Table 2.1 and 
u satisfies Condition 7 in Table 2.3; (ii) v satisfies Condition 3 in Table 2.1 and u satisfies 
Condition 3 in Table 2.3; (iii) v satisfies Condition 5 in Table 2.1 and u satisfies Condition 3 
in Table 2.3. The verifications in other situations are similar or relatively easier. 

Subcase (i): v(j) > i, v(j + 1) = i, i = u(j ) < u(j + 1). By Theorem 1.1, we have 

Ru q (q) = qRt’slvs,(q) + (? - l )R J u q Sj (<?)■ ( 2 -! 6 ) 

We need to compute Rusj,vsj (q) and Ru’ q Sj ('q ). We first compute Ru$ Sj (q)- Notice that u and 
vsj satisfy the relation in (2.9). By (2.1), we obtain that for 1 < k < n, 

a k (u,vsj) = |{r € u -1 ([i]) \ r < k}\ - |{r € (vsj-) — 1 ([*]) \ r <k}\ 

= |{r € « -1 ([* — 1]) | r < k}\ — |{r € u _1 ([i — 1 ]) | r < k}\ 

=a k (u,v). 

Moreover, by (2.4) we have 

D(u, vsj) = (vs i ) _ 1 ([i]) \u _ 1 ([i]) 

= D(u, v ). 


By the induction hypothesis, we deduce that 
R J u q vsM) ={-^ {VSj) ~ Ku) (l - q + 

l _ g _|_ q ] + a i( u ’ vs :i)'\ _ q ak(u,vsj) 

k£D(lL,VSj) 

1 -q + q l + a R u ’ v A JJ _ q a k(u,v) 

k£D(u,v) 


(2.17) 


To compute Rusj,vsj{q), we consider two cases according to whether usj < vsj. First, we 
assume that usj < vsj. Since usj and vsj satisfy the relation in (2.9), by ( 2 . 1 ) we see that 

a,j+i(usj, vsj) = aj + i(u,v) — 1 and a k (usj,vsj ) = a k (u,v), for k ^ j + 1 . (2.18) 

Moreover, by (2.4) we get 

D{usj , vsj) = (usj) _1 ([i]) \ (usj) _1 ([*]) 

= D(u,v)U{j}. (2.19) 


Combining (2.18) and (2.19) and applying the induction hypothesis, we deduce that 


(1-q) n (l -q a ^ us i’ vs i) 

k^D(usj ,vsj) 
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( 2 . 20 ) 


=( -l)*(«M(«) (l - q + S u - Hi _ 1)iV -! {i - 1)q 1+a ^-^ U ’ v) ) 

(1 - q) (l - [] (l - g^(u,v)J 

k£D(u,v) 

Substituting (2.17) and (2.20) into (2.16), we obtain that 
Ru q v(q) =QR£? j ,vs j (q) + (? - l ) Rj u%M^ 

= (-l (g (l - qOiM'j + (l- q + q l+aj(u,v)^ 

(1 - q) (l - q + 8 U - 1 (<-!),«-!«-!)g 1 -*- 0 *- 1 ( “* w) ) [] (l - q a ^) 

keD(u,v) 

= (_!)/(«)-<(«)(i - q) (l - q + 

JJ (l - . 

k(E.D(u,v) 

We now consider the case usj ^ usj. In this case, we claim that 

dj(u,v) = 0. (2-21) 

By (2.6)-(2.8), it can be checked that for 1 < k < n, 

bi,k(usj,vsj) = b ltk (u,v) and b 2 , k {us j: vsj) = b 2jk (u,v), 

and 

b 3 j + i(usj,vsj) = b 3:j+ i(u,v) - 2 and b 3jk (usj, vsj) = b 3 , k (u, v), for k / j + 1 . 

Since usj % vsj, by Proposition 2.6, we see that b 3 j +3 (u,v) — 2 < 0. On the other hand, since 
j + 1 € u _ 1 ([i]) but j + 10 u~ 1 ([i]), we have b 3 j + i(u, v) > 0. So we get b 3 j + i(u, v) = 1. 
Therefore, 

a,j(u,v) = b 3;j+ i(u,v) -1 = 0. 

This proves the claim in (2.21). 

Combining (2.17) and (2.21), we obtain that 

R J u q v (Q) =(?- 

=(-l)^~^\l-q) (l+ J] (l-g“*(«.«)) . 

k£D(u,v) 

Subcase (ii): v(j) > i, v(j + 1) < i — 1, u(j) < i — 1 and u(j + 1) = i. By Theorem 1.1, we have 

#$(?) = ( i R us j ,v Sj (q) + (q - (?)• ( 2 . 22 ) 

We need to compute Rusj,vsj(q ) and R.u% Sj ((/)■ We first compute Ru%sj(q)- Using (2.1), we get 
a,j + i(u, vsj) = a,j + i(u, v) — 1 and a k (u,vsj) = a k (u,v), iorkj^j + 1. 


10 


Moreover, by (2.4) we have 


D(u, vsj ) = D(u, v ) \ {j + 1}. 
By the induction hypothesis, we deduce that 


( 1 -q) (l - 9 °*(“«)) 

k£D(u,vsj) 

=( _l)^(«)-/(«)-i (i - g + 5 u -i(i-i) I v-i(i-i)? 1+ °’'- 1(i - 1 ’ (u ’ ,,) ) (i - 9) 

- 1 , v TT f l - g a * (u,,;) 

1 _ 0aj-+i(u,v) 11 V 


k£D(u,v) 


To compute j „, 5j (q), we consider two cases according to whether < vs r 
assume that ttsj < vsj. In view of (2.1), it is easy to check that 

a,j + i(usj, vsj) = a,j+i(u, v) — 2 and ak(usj,vsj) = a k (u,v), for k ^ j + 1 

Moreover, it follows from (2.4) that 


D(usj,vsj) = ( D(u,v) \ {j + 1}) U {j}. 


By the induction hypothesis, we obtain that 




(1-g) (l-q^ns^vsj)^ 

k£D(lLSj ,VSj) 

=(_!)*(«)-<(«) (l - q + S u -i(i -(1 - q) 


\ — q a j( us ji vs j) 
\ — q a j+i( u i v ) 


fl_ q ak(u,v) 


k£D(u,v) 

Substituting (2.23) and (2.24) into (2.22) and noticing the following relation 


aj(usj,vsj ) = a,j + i(u, v) — 1, 

we are led to formula (2.5). 

We now consider the case usj vsj. In this case, we claim that 

a j+ i(u,v) = 1. 

By (2.6)-(2.8), it is easily seen that 


bi )j+ i(usj,vsj) = bi J+1 (u,v) -2 and bi }k (usj, vsj) = bi >k (u, v), forfc/j + l, 

b 2} j+i(usj,vsj) = b 2 ,j+i(u,v) - 2 and b 2tk (usj,vsj) = b 2 , k (u,v), for k j + 1, 

b 3ij+1 (usj,vsj) = b 3J+ i(u,v) - 1 and b 3tk (usj,vsj) = b 3tk (u,v), forfc^j + l. 


(2.23) 

First, we 


(2.24) 

(2.25) 

(2.26) 

(2.27) 

(2.28) 
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It is clear that aj + \(u, v) = b 2 ,j+i(u,v). So the claim in (2.25) reduces to 

b 2 ,j+i(u,v) = 1 . 


Since j $ u _1 ([i — 1]) but j € w -1 ([i — 1]), we have b 2 j+i(u, v) >0. Suppose to the contrary 
that b 2 j+i(u,v) > 1. In the notation u _1 = pip 2 •••Pn and u _1 = q 3 q 2 ■ • • q n , we have the 
following two cases. 

Case (a): pi-\ < j. By (2.10), we see that < j and 

bi tj+ i(u,v) = b 2 ,j+i(u,v) > 1 . 

On the other hand, since j 0 u _ 1 ([i]) but j € u _ 1 ([i]), we have b 3 j + \(u, v) > 0. Hence we 
conclude that bh,k(usj,vsj) > 0 for h = 1, 2,3 and 1 < k < n. By Proposition 2.6, we get 
usj < vsj , contradicting the assumption usj vsj. 

Case (b): > j. In this case, we find that if qi-\ > j , then 

bi tj+ i(u,v) = b 2 ,j+i(u,v) > 1 , 

whereas if q t -\ < j, then 

b 1>j+ i(u,v) > b 2 ,j+i(u,v) > 1 . 

Note that in Case (a), we have shown that b 3> j+i(u, v) > 0. So, we obtain that bh t k(usj,vsj ) > 0 
for h = 1,2,3 and 1 < k < n. Thus we have usj < vsj, contradicting the assumption usj ^ vsj. 
This proves the claim in (2.25). Substituting (2.25) into (2.23), we arrive at (2.5). 


Subcase (iii): v(j) = i — 1, v(j + 1) < i — 1, u(j) < i — 1 and u(j + 1) = i. By Theorem 1.1, 
we have 

R J u q v {<i) = qRislvs, (q) + (q- l )R J u q v Sj (?)■ ( 2 - 2 9) 

We need to compute R'us :i ,vsj(q) and Ru% Sj (q )• By (2.1), we see that for 1 < k < n, 

a k (u,vsj ) = a k (u,v). 


Moreover, by (2.4) we have 

D(u,vsj) = D(u,v). 

By the induction hypothesis, we obtain that 

Rt%(q) =(-i)^ MH (i - qf If i 1 - q ak{u ’ VSj) ) 

k£D(u,vsj) 

= (_l)^)-W-i(l_ g )2 Yl (l~q ak ( u ’ v) Y (2.30) 

kED(u,v) 


To compute Rus :j ,vs :i (q)-, we claim that usj < vsj. By (2.6)-(2.8), we see that 
bij + i(usj,vsj) = b\j + i(u,v) — 2 and bi tk (usj, vsj) = b\ tk (u, v), forfc^j + 1, (2.31) 

b 2 ,j+i(usj,vsj) = b 2 ,j+i(u,v) - 1 and b 2 ,k(usj,vsj) = b 2 ,k(u,v), forfc/j + l, (2.32) 

b 3tk (usj,vsj ) = b 3tk (u,v), for 1 < k < n. (2.33) 

Since j + 1 € u -1 ([i — 1]) but j + 10 u -1 ([i — 1]), we have 62^+1 (u, u) > 0, which implies that 

b 2 j + i(usj,vsj) = b 2 ,j+i(u,v) — 1 > 0. (2.34) 
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Moreover, since pi-\ > g,._i = j, we have p t -\ > j. So, we deduce that 

bi tj+1 (u,v) = b 2 ,j+i(u,v) + 1 > 1 , 

and hence 

bij +1 (usj,vsj) = bi tj+ i(u,v) - 2 > 0. 

Therefore, for h = 1, 2, 3 and 1 < k < n, 

bh,k(usj,vsj) > 0 , 

which together with Proposition 2.6 yields that usj < vsj. This proves the claim. 

By (2.1) and (2.4), it is easily verified that 

a,j+i(usj, vsj) = a,j + i(u,v) — 1 and a,k(usj,vsj ) = ak(u,v), for k ^ j + 1 

and 

D(usj,vsj) = ( D(u , u) \ {j + 1}) U {j}. 

By the induction hypothesis, we deduce that 

- q ) 2 n i 1 - q ak{uSj ’ VSj) ) 

k£D(uSj ,vsj) 


(2.35) 


I! (l - 9“‘ ( "'”>) ' (2.36) 


Since aj(usj,vsj ) = aj_|_i(u,u), formula (2.36) becomes 


k£D(u,v) 


R 


J,q 


. (?) = (- 1 )A«)-A«) (1 _ g )2 j 

k£D(u,v) 


(2.37) 


Substituting (2.30) and (2.37) into (2.29), we are led to (2.5). This completes the proof. I 
We conclude this paper with a conjectured formula for Ru’ q (q), where 

J — 6 \ {s/j, Sfc-|_i,..., Sj} 

with l<k<i<n— 1 and k + 1, k + 2,..., * appear in increasing order in v. By (1.1) and 
(1.3), a permutation u £ S n belongs to ( S n ) J if and only if the elements 1,2,... ,k as well as 
the elements i + 1, i + 2,..., n appear in increasing order in u. Let u, v be two permutations in 
(S n ) J . Write u^ 1 = p\p 2 ■ ■ ■ p n and u _1 = qiq- 2 ■ ■ ■ q n - Let 

A(u, v) = {t | k + 1 < t < i, p t > qt}- 

Set B(u,v) to be the union of { 1 , 2 ,... ,k} and A{u,v). Based on the set B(u,v ), we define 
aj(u,v) and D(u,v) in the same way as in (2.1) and (2.4), respectively. 

The following conjecture has been verified for n < 8 . 

Conjecture 2.7 Let J = S \ {s*,, Sfc+i,..., s*}, and v be a permutation in ( S n ) J such that 
k +1, k + 2,..., i appear in increasing order in v. Then, for any u £ ( S n ) J with u < v, we have 


l 

R J u’ q v (q ) = (-1)^ H n (i - q + Su-Ht), v-Ht)q 




t=k -\-1 


n i 1 - 

j&D(u,v) 
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Conjecture 2.7 contains Theorems 1.3, 1.4 and 2.5 as special cases. When i = n — 1 and 
k = 1, Conjecture 2.7 becomes a conjectured formula for ordinary if-polynomials R UtV (q), that 
is, if v is a permutation in S n such that 2 ,3,..., n — 1 appear in increasing order in v, then for 
any u < v, 


71 — 1 


R, 


.,„(?) = (-!)*«-*“> n (l - 9 + 




(0 


(u,v) 


t =2 


n 

j£D(u,v) 


1 _ q a i( u ’ v )'j 
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